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(57)Abstract: 0 
PROBLEM TO BE SOLVED: To build up a system that 
edits a video image automatically from a corresponding 
video image by producing a video contents grasping aid 
output from part of each video source. 
SOLUTION: A video image block division stage 20 
divides an input video image 0 into some video blocks 1 . 
A video image representative image output stage 21 
outputs a representative image 2 as index information to 
each video block 1. An editor 10 provides an instruction 
1 1 based on the representative image 2, a 
representative image layout stage 22 edits a source to 
obtain a layout result 3 as an aid output matter of 
grasping video contents. A video image edit stage 23 
edits the video image based on the layout result 3. A 
representative image reduction stage 24 evaluates a relation of the representative image for 
the representative image on the layout result 3 to reduce number of representative images. A 
reduced representative image 5 obtained thereby is viewed in a representative image display 
stage 25 by a viewer 14 that is an editor and a user by means of a display device 13. 
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* NOTICES * 

JPO and INPIT are not: responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 *♦** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Arranging and outputting an image material and performing an editing task to an image 
material based on the output The image section division phase of displaying the arranged image 
material, being the layout image edit approach with a page display function to output, and dividing an 
image material per section, The representation image output stage story which outputs a representation 
image for every divided this image section, The representation image layout phase of obtaining a layout 
result with arranging this representation image, The image edit phase of formatting an image 
automatically according to this layout result, and the representation images which were used for this 
layout result the magnitude of a representation image, a configuration, a representation image, and 
correspondence — the price — ******** — an image — the section — according to the description of 
representation images, such as die length, with the representation image reduction phase which the 
number of a representation image is decreased and generates a reduction representation image by 
correlation The layout image edit approach with a page display function characterized by providing the 
representation image display phase which displays this reduction representation image. 
[Claim 2] Performing an editing task to an image material based on the layout result of having arranged 
the image material The image edit phase of displaying the arranged image material, being the layout 
image edit approach with a page display function to output, and formatting an image automatically 
according to a layout result, The representation images used for this layout result The magnitude of a 
representation image, a configuration, a representation image, and correspondence — the price — 
******** — an image — the section — according to the description of representation images, such as die 
length, with the representation image reduction phase which the number of a representation image is 
decreased and generates a reduction representation image by correlation The layout image edit approach 
with a page display function characterized by providing the representation image display phase which 
displays this reduction representation image. 

[Claim 3] Arranging and outputting an image material and performing an editing task to an image 
material based on the output An image section division means to display the arranged image material, to 
be layout image edit equipment with a page display function to output, and to divide an image material 
per section, A representation image output means to output a representation image for every divided this 
image section, A representation image layout means to obtain a layout result with arranging this 
representation image, An image edit means to format an image automatically according to this layout 
result, and the representation images which were used for this layout result the magnitude of a 
representation image, a configuration, a representation image, and correspondence — the price — 
******** — an image — the section — according to the description of representation images, such as die 
length, with a representation image reduction means to decrease the number of a representation image 
and to generate a reduction representation image by correlation Layout image edit equipment with a 
page display function characterized by providing a representation image display means to display this 
reduction representation image. 

[Claim 4] Performing an editing task to an image material based on the layout result of having arranged 
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the image material An image edit means to display the arranged image material, and to be layout image 
edit equipment with a page display function to output, and to format an image automatically according 
to a layout result, The representation images used for this layout result The magnitude of a 
representation image, a configuration, a representation image, and correspondence — the price — 
******** mm m j ma g e „ ^e section — according to the description of representation images, such as die 
length, with a representation image reduction means to decrease the number of a representation image 
and to generate a reduction representation image by correlation Layout image edit equipment with a 
page display function characterized by providing a representation image display means to display this 
reduction representation image. 

[Claim 5] The record medium which recorded the layout image editor program with a page display 
function characterized by what the program for a computer to realize each phase in the layout image edit 
approach with a page display function according to claim 1 or 2 was recorded for on the record medium 
which this computer can read. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT axe not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] In case this invention analyzes and edits photography and the image acquired 

through the network, it relates to the system which makes image edit easy. 

[0002] 

[Description of the Prior Art] The general public records and photos the image more often very much 
from a small video camera and the spread of videocassette recorders. 

[0003] However, edit of an image needs to view, listen to them and grasp the contents, and since it 
needs the repetitive activity of viewing and listening to a repeat image, it has the situation that almost all 
people are not performing the editing task, with a difficult activity. 

[0004] Although it is thought that there are some troubles, it is difficult for the 1st to grasp the contents 
of the photoed image, and the conventional editor does not receive constraint of a hour entry greatly, and 
only sequential access is allowed, but since the trouble of being unable to access at random was held, 
and a great effort and time amount were needed for the editing task, it is considered. Moreover, for 
viewing and listening of an image to have had few opportunities to make the 3rd person view and listen 
to an image, even if edit is performed with much trouble, and to have become a failure, since time 
constraint was given strongly is considered by the 2nd. 
[0005] In order to promote image edit, 1 . image editing task be easy. 

[0006] 2. As a result of an image editing task, it is easy to understand the contents of the made image in 
what kind of thing, and listens [ are and ] easy to view. 
[0007] Two ** are considered to be required. 

[0008] In order to analyze an above-mentioned trouble, some conventional approaches are proposed. 
[0009] In order to solve the trouble of the sequential access in the image edit which is the 1st trouble, 
use of a non-linear-editing machine prospers. This formed the image into the digital dynamic image, 
made random access possible by recording the activity under edit to a hard disk, and has realized the 
easy editing task. As for this non-linear-editing machine, some famous things are already proposed, and 
you may say that that interface is standardized as a matter of fact by the thing of displaying the time line, 
and meeting and displaying an image icon on the time line. This develops and displays all the 
information on the direction of time amount of an image in the direction of space. As the famous 
example, it is Avid. Media Series, such as Composer and Premiere of an Adobe company, exists. 
Although these approaches are generalized and it is already used also in broadcast or an image 
production, since a powerful thing is needed for the hardware demanded, difficulty follows on the 
general public treating. So, in order to generalize image edit more, the thing in which an image editing 
task is possible is desirable, without barring constraint of such a location etc. 

[00 1 0] As one proposal which you grasp [ proposal ] the contents of the image simply and makes it view 
and listen to them on the other hand in order to solve the 2nd trouble By the information on the cutting 
point of image information being extracted and displayed, or camera work information being extracted, 
and an image being shifted an acted part of camera work What created the image of the whole camera is 
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arranged on a screen or paper. Some approaches of displaying are proposed 0- [ Yukinobu Taniguti, 
Yoshinobu Tonomura, ] [ "Panorama Excerpts :Extracting and packing ] Panoramas for Video Browsing 
ACM Multimedia97 - [1]." 1996 
[0011] 

[Problem(s) to be Solved by the Invention] However, these conventional approaches can perform only 
the problem solving according to individual. Although it is also expectable for combining simply to be 
able to manufacture what can solve a trouble to some extent, although it is effective in a mechanical 
understanding of the contents to some extent, when not an attractive interface but an editor uses for edit, 
even if the conventional approach [1] is effective, by itself, viewing and listening to a user is not urged 
to it. This is because it is performing selecting the mechanical description etc. out of the edited image. 
Therefore, for the viewer, which was required, and it turned out which [ unnecessary ] it was an image 
with, and did not lead to ****** and positive viewing and listening of a viewer. 

[0012] Moreover, as mentioned above, the expansion not only to the direction of space but the direction 
of time amount is needed for an image. Since it was the narrow range, the image of one frame of an 
image performed expansion to the direction of time amount, and it is changing the field angle to a 
photographic subject, an angle type, etc., and was performing production in an image. Therefore, if the 
point changing [ shot ] is mechanically displayed as shown in the above-mentioned conventional 
approach [1], the number of the image displayed increases, and becoming a problem is known in case a 
part to view and listen is taken out from one image work. Since the difference has arisen between the 
display density of the contents of an image on the basis of the shot change produced at the time of image 
edit, and the consistency of the contents of an image for which a contents grasp exchange output object 
is asked, this shows not becoming equivalent to the thing based on the mechanical characteristic 
quantity from an image, i.e., a contents grasp exchange output object. 

[0013] However, for the editor of an image, after ending an image editing task Adding to an image the 
contents grasp exchange output object which is an exchange tool for contents grasp of an image which 
furthermore makes viewing and listening of an image attractive, and generating it Since it will be 
necessary to make still more nearly another contents to the activity originally finished only as the editing 
task of an image, the problem that the effort more than the former is required is raised to it with a very 
troublesome activity. 

[0014] Therefore, if there is a system of the system into which an image is edited automatically, and 
******** when the system which will make a contents grasp exchange output object automatically if 
image edit is performed, and the contents grasp exchange output object is made, it will be thought that 
such a problem is solvable. 

[001 5] So, in this invention, if the contents grasp exchange output object of an image is made from some 
each image material, an image will make it a technical problem automatically to build the system edited 
and generated from a corresponding image. Furthermore, let it be a technical problem to build the 
system also in consideration of also burying the difference of the consistency of the contents of an image 
for which image work is asked, and the consistency of the contents of an image for which a contents 
grasp output object is asked. 
[0016] 

[Means for Solving the Problem] As above-mentioned The means for solving a technical problem, this 
invention is listed below. 

[0017] Invention of (1) arranging and outputting an image material and performing an editing task to an 
image material based on the output The image section division phase of displaying the arranged image 
material, being the layout image edit approach with a page display function to output, and dividing an 
image material per section, The representation image output stage story which outputs a representation 
image for every divided this image section, The representation image layout phase of obtaining a layout 
result with arranging this representation image, The image edit phase of formatting an image 
automatically according to this layout result, and the representation images which were used for this 
layout result the magnitude of a representation image, a configuration, a representation image, and 
correspondence — the price — ******** an image — the section — according to the description of 
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representation images, such as die length, with the representation image reduction phase which the 
number of a representation image is decreased and generates a reduction representation image by 
correlation It is the layout image edit approach with a page display function characterized by providing 
the representation image display phase which displays this reduction representation image. 
[0018] Invention of (2) performing an editing task to an image material based on the layout result of 
having arranged the image material The image edit phase of displaying the arranged image material, 
being the layout image edit approach with a page display function to output, and formatting an image 
automatically according to a layout result, The representation images used for this layout result The 
magnitude of a representation image, a configuration, a representation image, and correspondence — the 
price - ******** ~ an image -- the section according to the description of representation images, 
such as die length, with the representation image reduction phase which the number of a representation 
image is decreased and generates a reduction representation image by correlation It is the layout image 
edit approach with a page display function characterized by providing the representation image display 
phase which displays this reduction representation image. 

[0019] Invention of (3) arranging and outputting an image material and performing an editing task to an 
image material based on the output An image section division means to display the arranged image 
material, to be layout image edit equipment with a page display function to output, and to divide an 
image material per section, A representation image output means to output a representation image for 
every divided this image section, A representation image layout means to obtain a layout result with 
arranging this representation image, An image edit means to format an image automatically according to 
this layout result, and the representation images which were used for this layout result the magnitude of 
a representation image, a configuration, a representation image, and correspondence — the price — 
******** — an image — the section — according to the description of representation images, such as die 
length, with a representation image reduction means to decrease the number of a representation image 
and to generate a reduction representation image by correlation It is layout image edit equipment with a 
page display function characterized by providing a representation image display means to display this 
reduction representation image. 

[0020] Invention of (4) performing an editing task to an image material based on the layout result of 
having arranged the image material An image edit means to display the arranged image material, and to 
be layout image edit equipment with a page display function to output, and to format an image 
automatically according to a layout result, The representation images used for this layout result The 
magnitude of a representation image, a configuration, a representation image, and correspondence — the 
price — ******** — an image — the section - according to the description of representation images, 
such as die length, with a representation image reduction means to decrease the number of a 
representation image and to generate a reduction representation image by correlation It is layout image 
edit equipment with a page display function characterized by providing a representation image display 
means to display this reduction representation image. 

[0021] Invention of (5) is the record medium which recorded the layout image editor program with a 
page display function characterized by recording a program for a computer realizing each phase in the 
layout image edit approach with a page display function the above (1) or given in (2) on the record 
medium which this computer can read. 

[0022] In this invention, extracting a part of information from an image material, and constituting a 
detailed contents grasp output object, according to the information on the contents grasp output object, 
the information on the already constituted contents grasp output object is followed, and an image is 
edited and generated. Furthermore, in order to make a contents grasp output object easier to treat, it is 
processed so that the contents of the contents grasp output object may be decreased, and displays. 
[0023] 

[Embodiment of the Invention] The gestalt of concrete operation of the layout image edit approach with 
a page display function by this invention and equipment is explained below. 

[0024] The processing flow Fig. of the layout image edit approach with a page display function by the 
example of 1 operation gestalt of this invention is shown in drawing 1 . 
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[002S] In order to generate the image material which turns into a material of an image 4 edited and 
processed from the input image 0, the image section division phase 20 divides an image at some image 
sections 1. 

[0026] The representation image 2 used as the index information in the case of image edit is outputted 
on the image representation image output stage story 21 to this image section. 

[0027] The editor 10 who is a user based on the representation image 2 gives directions 11, according to 
the representation image layout phase 22, edits a material and obtains the layout result 3. This layout 
result 3 serves as an exchange output object for grasping the contents of the image to generate, and 
actually edits an image based on this layout result 3. 

[0028] To the representation image on a layout result, the representation image reduction phase 24 
estimates the relation of a representation image, and the number of a representation image is decreased 
according to it. This obtains the reduction representation image 5. According to representation images 
decreasing in number, the correspondence between a representation image and the corresponding image 
section also changes. Therefore, correspondence between a reduction representation image and the 
edited image also changes. 

[0029] On the other hand, in order to display a reduction representation image on an editor or other 
users, it is made to view and listen through display 13 to a viewer 14 in the representation image display 
phase 25. 

[0030] In addition, compression coding of MPEG, the JPEG, etc. may be carried out that the input 
image 0 should just be a digital image in which analysis of a computer is possible. The parameter to the 
time amount and the direction of space is arbitrary, and is not cared about. Moreover, when it is not a 
digital image, the image section division phase 20 may be equipped with the function to digitize 
according analog image data, to a capture tool etc. The same property is reflected also about the image 
section 1 . 

[0031] The representation image is carried out based on each image section, and various representation 
images are generated according to the characteristic quantity obtained from the image section. Although 
the easiest thing is the case where the frame immediately after a shot change is used as it is, it does not 
need to be immediately after a shot change, is choosing frames, such as just before a shot change, a thing 
of the butterfly middle of a shot change and the next shot change, and what has the highest lightness, a 
high thing of a hue, and can also be used as a representation image. Moreover, initiation of camera work, 
termination, and camera work may choose the frame currently performed to max, it can move according 
to the frame at blurring, the case where a rapid motion of a photographic subject removes a sudden part, 
and the time of those initiation and termination, the existence of a motion photographic subject, and the 
existence of a motion photographic subject, and a frame called frames, such as an appearance of a 
photographic subject and disappearance, can also be used as it is. Moreover, a motion gap of camera 
work may be measured based on the extracted camera work information, and images, such as a highly 
minute image generated because only the gap shifts a time series image, may be used. When it moves 
into this highly minute image and a photographic subject exists, what stuck the motion photographic 
subject into this highly minute image is made possible. These representation images are generated based 
on the contents of the time amount section which has an image, respectively, and reflect some contents 
of the image. It supposes that the semantics which represents a part of image which created it is given, 
and the link is given to these representation image. In addition, there is not necessarily no need that a 
link is a one to one correspondence. According to various conditions, two or more links may exist, and it 
does not matter even if it is a nest. 

[0032] An image and the corresponding representation image are arranged according to the layout by 
which the representation image was generated, and the image which an editor desires is generated. 
Under the present circumstances, even if it merely chooses a layout in order and it not only arranges in a 
certain appointed field, but it adds text information, such as words in a title, sound effects, and comics, 
in addition to modification of spatial processing of expansion, contraction, telescopic motion, rotation, 
etc., a lightness, a hue, etc., etc., it is a part of such a layout. Moreover, the resolution of a representation 
image may be changed, or a part may be twisted, it may carry out and the rarefaction of all may be 
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carried out. Each of these is processings required in order to manufacture comics, and serves as 
important processing expressing the intention to an editor's image manufacture. 
[0033] On the occasion of the layout, the representation image will be arranged on a certain electronic 
page. Here, this page is the electronized imagination field. The page size, a configuration, a color, etc. 
are arbitrary, and are not cared about. Of course, you may make it a uniform page. The location arranged 
on this page is arbitrary, and is not cared about. An arrangement called the right and the bottom to a top 
may be freely performed from the Ruhr said from the left from a top to the bottom to the right, and the 
left. 

[0034] The layout result of having used a part of these images can be obtained by two or more 
representation images being chosen, processed and arranged. A layout result is the contents grasp 
exchange output object which was generated from the contents of the image material and was generated 
based on the information on the representation image reflecting the contents of the image, is put into 
information, such as words and sound effects, by the layout result, and can grasp a great portion of 
contents from a layout result to it. 

[0035] In the image edit phase 23, an image is connected and edited into the sequence which has 
arranged the image section 1 corresponding to the representation image under layout based on the layout 
result 3. Moreover, if text information etc. and the directions to the time of edit are given beforehand, an 
image will be edited reflecting the directions corresponding to it. The image 4 edited by this is acquired. 
This edited image 4 is supplied to the graphic display phase 26, and a viewer 14 is made to view and 
listen by display 13. 

[0036] On the other hand, although the contents of the image are reflected in order to edit an image and 
to use it in this layout result 3 based on the output object which supports contents grasp, although the 
layout result 3 serves as an output object which supports contents grasp of the edited image and display 
12 is performed to an editor 10, the consistency of an image differs from the display density of each 
contents of an image required for contents grasp. Generally, rather than all the shots per hours of the 
image to edit, if the representation image of the small number exists, it is said that it is enough. Then, 
the relation between representation images is found and the number of a representation image is 
decreased. This processing is performed in the representation image reduction phase 24. Here, 
evaluation on an absolute scale or the relative evaluation limited in the same electronic page estimates 
the magnitude, a configuration, and a representation image and the linked image section die length to 
each representation image, and representation image relation is changed. For example, the small 
representation image contiguous to a huge representation image makes matching and a small 
representation image eliminate the image section corresponding to the both sides of a representation 
image even with a huge huge representation image, and a small representation image. On the layout 
result which is a contents grasp exchange output object, the number of a representation image will 
decrease as a result of this processing. The reduction representation image 5 which it is as a result of 
[ which was obtained by decreasing a representation image ] a layout is thrown into the representation 
image display phase 25 or the graphic display phase 26, and a viewer 14 is made to view and listen by 
display 13. 

[0037] Next, the block diagram for realizing the equipment configuration by the example of 1 operation 
gestalt of this invention is displayed on drawing 2 . 

[0038] In order to generate the image material which turns into an edited material of an image 34 from 
the input image 30, the image section division means 50 divides an image at some image sections 31. 
[0039] The representation image 32 used as the index information in the case of image edit is outputted 
with the image representation image output means 51 to this image section. 

[0040] The editor 40 who is a user based on the representation image 32 gives directions 41, with the 
representation image layout means 52, edits a material and obtains the layout result 33. This layout 
result serves as an exchange output object for grasping the contents of the image to generate, and 
actually edits an image based on this layout result 33. The image 34 edited by processing the layout 
result 33 to the image section 1 used as delivery and a material for the image edit means 53 can be 
acquired. 
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[0041] On the other hand, to the representation image on the layout result 33, with the representation 
image reduction means 54, the number of a representation image is decreased and the reduction 
representation image 35 is obtained. A viewer 44 views and listens to the image 34 edited by one side 
through the display 43 by the graphic display means 56 through the display 43 according this reduction 
representation image and a layout result to the representation image display means 55. in order [ in 
addition, ] for the image itself edited even if representation images decreased in number not to change — 
each representation image — correspondence — the price — **** — an image — the section — it remains 
for the relation between representation images to only change, this representation image reduction 
means 54 and correspondence -- the price - about the relation between the image 34 by which **** edit 
was carried out, and the representation image display means 55, a detail is mentioned later. 
[0042] Compression coding of MPEG, the JPEG, etc. may be carried out that the input image 30 should 
just be a digital image in which analysis of a computer is possible. The parameter to the time amount 
and the direction of space is arbitrary, and is not cared about. Moreover, 50 may be equipped with the 
function to digitize according analog image data, to a capture tool etc. when it is not a digital image. The 
same property is reflected also about the image section 31. 

[0043] The representation image is carried out based on each image section, and various representation 
images are generated according to the characteristic quantity obtained from the image section. Although 
the easiest thing is the case where the frame immediately after a shot change is used as it is, it does not 
need to be immediately after a shot change, is choosing frames, such as just before a shot change, a thing 
of the butterfly middle of a shot change and the next shot change, and what has the highest lightness, a 
high thing of a hue, and can also be used as a representation image. Moreover, initiation of camera work, 
termination, and camera work may choose the frame currently performed to max, it can move according 
to the frame at blurring, the case where a rapid motion of a photographic subject removes a sudden part, 
and the time of those initiation and termination, the existence of a motion photographic subject, and the 
existence of a motion photographic subject, and a frame called frames, such as an appearance of a 
photographic subject and disappearance, can also be used as it is. Moreover, a motion gap of camera 
work may be measured based on the extracted camera work information, and images, such as a highly 
minute image generated because only the gap shifts a time series image, may be used. When it moves 
into this highly minute image and a photographic subject exists, what stuck the motion photographic 
subject into this highly minute image is made possible. These representation images are generated based 
on the contents of each image section, and reflect some contents of the image. It supposes that the 
semantics which represents a part of image which created it is given, and the link is given to these 
representation image. In addition, there is not necessarily no need that a link is a one to one 
correspondence. According to various conditions, two or more links may exist, and it does not matter 
even if it is a nest. 

[0044] A representation image is arranged based on directions of an editor. In this layout processing, an 
image and the corresponding representation image are arranged and the image for which an editor 
wishes is generated. Under the present circumstances, it may merely choose a layout in order, in 
addition to modification of spatial processing of expansion, contraction, telescopic motion, rotation, etc., 
a lightness, a hue, etc., etc., it not only arranges in a certain appointed field, but it may add text 
information, such as what hits a title and sound effects, for example, the words in comics work, and 
these are a part of layouts. Moreover, the resolution of a representation image may be changed, or a part 
may be twisted, it may carry out and the rarefaction of all may be carried out. Each of these is 
processings required in order to manufacture comics, and serves as important processing expressing the 
intention to an editor's image manufacture. 

[0045] On the occasion of the layout, the representation image will be arranged on a certain electronic 
page. This page is the electronized imagination field here. The page size, a configuration, a color, etc. 
are arbitrary, and are not cared about. Of course, you may make it a uniform page. The location arranged 
on this page is arbitrary, and is not cared about. An arrangement called the right and the bottom to a top 
may be freely performed from the Ruhr said from the left from a top to the bottom to the right, and the 
left. 
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[0046] The layout result of having used a part of these images can be obtained by two or more 
representation images being chosen, processed and arranged. A layout result is the contents grasp 
exchange output object which was generated from the contents of the image material and was generated 
based on the information on the representation image reflecting the contents of the image, puts 
information, such as words and sound effects, into a layout result, and can grasp a great portion of 
contents only by seeing a representation image to it. 

[0047] An image is connected and edited into the sequence which has arranged the image section 
corresponding to the representation image on a layout result from the layout result of having arranged 
this representation image. Moreover, if text information etc. and the directions to the time of edit are 
given beforehand, an image will be edited reflecting the directions corresponding to it The image edited 
by this is acquired. 

[0048] Relation with the image made from the layout result is shown in drawing 3 . (a) is as a result of a 
layout, and the configuration of an all directions form shows the representation image. The small figure 
under each representation image shows the sequence of a layout, respectively. In addition, the 6th 
representation image is an example of a highly minute image made to rival being conscious of a gap of 
the migration in the same scene, when there is a motion of camera work etc. The result of having edited 
the image section which corresponds based on the image edit means 53 from this layout result is the 
edited image section which is shown in (b). The number of the representation section and the number of 
the image section correspond, respectively. 

[0049] On the other hand, to a layout result, the number of a representation image is decreased through 
the representation image reduction means 54, and the reduction representation image 35 is obtained. A 
representation image is improved and it is made to decrease here according to the appointed Ruhr. This 
processing compares the configuration of a representation image, magnitude, the image section die 
length corresponding to a representation image, etc., and evaluates representation images. This 
evaluation is good also by absolute evaluation, and good as for a dimension in the relative evaluation on 
the same page. 

[0050] The representation image display means 55 performs display 43 to a viewer 44 based on the 
reduction representation image 35 obtained when representation images decreased in number as a result 
of evaluation of representation images. A viewer 44 discovers the image section corresponding to the 
representation image to wish to have based on the reduction representation image and layout result 
which were displayed, and displays, views and listens to an image on it. You may reproduce on the 
arranged result, and another window on an electronic monitor is available for the display of the image 
itself, and it may be displayed on the monitor whom others became independent of. In addition, the 
display of a layout result shall change further if needed for a viewer 44. 

[0051] The example from which the representation image reduction means and the relation between 
representation images by it changed to below is shown. 

[0052] As the first example shows drawing 4 , adjoining representation images are compared and the 
small representation image which appears later in time is based on the Ruhr absorbed by the big 
representation image which appears immediately before of removing a small representation image. That 
is, the image section when the representation images 101-104 on the layout result shown in (a) existed 
at, and (c) edit was first carried out by corresponding exists. The die length of the longitudinal direction 
of (c) shall show the time amount length of the image section. In the example of this drawing 4 , the 
small representation image 104 is absorbed by the large representation image 103, and the representation 
image relation which carried out (b) change is obtained from the relation between the images with which 
it adjoins in the same page based on size relation here. The layout result displayed at this time will be in 
the condition that the representation image 104 was lost. However, it is changeless on the image itself 
edited by one side, and is only that correspondence with a representation image and the image section 
changes. The two sections of the image sections 203 and 204 correspond to (d) so that the thing 
corresponding to the representation image 103 may be shown. 

[0053] It is the case where the Ruhr of choosing one representation image is followed on the same page 
as the second example at drawing 5 . Other representation images are absorbed, it is removed by the 
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greatest representation image in the page in the layout result of (a), a result and one representation image 
103 shown in (b) are obtained, and it is shown that the image sections 201-204 are altogether matched 
with the representation image 103 as shown in (d). 

[0054] As the third example, in case drawing 6 chooses one representation image on the same page, it is 
the example which changed the configuration of a representation image based on the information on the 
matched image section rather than the characteristic quantity of a representation image. In this example, 
although the representation image 104 chosen as shown in (b) is small as compared with other 
representation images in the layout result of (a), choosing the representation image 104 corresponding to 
the longest image section 204 based on the image section die length of (c), and changing the 
representation image on a page is shown. 

[0055] Of course, the separate Ruhr other than the Ruhr shown in the example of drawing 4 - drawing 6 
may be prepared, for example, — giving priority to the number of the alphabetic characters of text 
information, and area, when priority is given to them when not a big representation image but a small 
representation image is chosen or text information, such as a title, is added to the representation image, 
and two or more text information exists **** — etc. — it is processing. 

[0056] Moreover, of course, it is also possible to perform processing between pages. Processing in 
which remove other representation images, evaluate the representation images for every page, and it 
decreases in the page itself is also possible so that a representation image may be set to one for every 
page. 

[0057] Moreover, automatic distinction is not carried out with characteristic quantity, but you may make 
it change the representation image removed or chosen with the directions from an editor. 
[0058] In addition, in drawing 4 , four representation images on the same page are used as three 
representation images, and drawing 5 and drawing 6 are using four representation images as one 
representation image. Change of the number of such a representation image may be carried out to 
immobilization, and it does not matter even if it changes according to a use demand of an editor. What is 
necessary is for the characteristic quantity which should be evaluated [ section / magnitude, area, 
average lightness, / corresponding / image ] to choose the greatest representation image, respectively, 
and to remove other representation images and just to make all the sections corresponding to the 
removed representation image correspond to the greatest representation image, if it considers as one 
representation image at each page, either of the representation images from which the image section 
which chose the greatest thing based on each characteristic quantity and the following as two cases, 
removed other representation images, and supported the removed representation image was not removed 
-- correspondence — the price --**** is good, the inside of the image sections which correspond in 
matching the image section — most ~ time — a near representation image — correspondence ****** — 
what is necessary is just to make it like 

[0059] With the directions from an editor, the number of sheets of the representation image which 
decrease in number for every page may be limited, and you may process limiting the number of a 
representation image, while two or more pages are included etc. What is necessary is just to match by 
choosing a part for the number from what has the big characteristic quantity to evaluate regardless of a 
page, in crossing to two or more pages. 

[0060] It is possible to express a reduction representation image thru/or a layout result as a 
representation image display means. Directions of a user perform this change. Moreover, directions of a 
user may be perceived and you may process carrying out automatically etc. 

[0061] The example of the usage at the time of a viewer using this example of an operation gestalt is 
shown in drawing 7 . 

[0062] A user views and listens to what was collected by the representation image of one sheet for every 
page with a contents grasp display means, as first shown in (a). A page (b) to view and listen here is 
extracted. Subsequently, all the representation all [ some thru/or ] (c) removed although it existed in one 
representation image on a page are displayed. The layout result will be displayed when indicating all. A 
viewer can choose the representation image 402 wished to have out of these representation image groups 
401-405, and can view and listen to the image section 502 corresponding to 402 (d). The means 
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displayed on the same page on which the removed representation image is displayed is not in one sheet 
or all, and a representation image may specify a certain amount of level, and it may express it as the 
middle level of two sheets and three sheets. If the service image of drawing 7 is followed, it will become 
possible to view and listen to an image along with the consistency of the contents of the suitable image. 
[0063] As mentioned above, explanation has been added about layout image edit equipment with a page 
function. It can guess easily adding various arrangements to the above-mentioned example of an 
operation gestalt, and they are also within the limits of this invention. This interface has taken a 
approach of generating an image automatically at the same time it edits a contents grasp exchange 
output object, and it has the description that an image and the layout output which introduces the 
contents of the image are generable. By this approach, an editor is more intelligible and a user can build 
the environment to which are and it listens easier to view. 

[0064] In addition, if a computer program indicates this approach, an archive medium, preservation 
media, such as an image, and a program are read and the computer to perform exists, it is also possible 
to carry out this invention. In that case, it records on record media, such as FD (floppy disk), and MO, 
ROM, a memory card, CD and DVD, a removable disk, and provides, and a computer program can be 
distributed. 
[0065] 

[Effect of the Invention] In image edit, a user generates a contents grasp output object and an image 
simply, and this invention makes it possible to make an image easy to treat. Moreover, in a contents 
grasp output object, it has the effectiveness of becoming easy to look for the more important image 
section by sorting out the representation image which evaluates a representation image and is considered 
to be important, from the characteristic quantity of the arranged representation image, and becomes 
effective in promotion of use of an image. 
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